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BIORTHOGONAL SYSTEMS OF FUNCTIONS* 

BY 

ANNA JOHNSON PELL 

Introduction. 

In boundary value problems of differential equations which are not self- 
adjoint, biorthogonal systems of functions play the same role as the orthogonal 
systems do in the self -ad joint case. LiOTlViLLEf has considered special non- 
self-adjoint differential equations with real characteristic values of the parame- 
ter ; BiRKHOFF \ has proved the existence of the characteristic values (in general 
complex) for the differential equation of the wth order and obtained the related 
expansions. 

If the integral equation 

m(s)=x| L{s,t)u{t)dt 

tJa 

with the unsym metric kernel L{s, t) has solutions m(s), and therefore the 
integral equation 

v{s) = \ I L{t, s)v{t)dt 

*J a 

solutions t) ( s ) ? it has been shown by Plemelj § and GoURSAT || that the solu- 
tions or functions closely related to them form a biorthogonal system. But 
expansions in terms of these solutions have not been obtained, and no criteria 
have been given for the existence of real characteristic numbers of an unsymmetric 
kernel.^ 

The object of this paper is the development of a theory of biorthogonal systems 
of functions independent of their connection with integral or differential equa- 
tions. In the theory frequent use is made of the theorems by KiESZ, Fischer, 
and ToEPLiTZ (Lemmas 1, 2, 3, and 4, § 2). 

* Presented to the Society (Chicago) April 10, 1909. 

tLiouville's Journal, ser. 1, vol. 3 (1838). 

t Transactions of the American Mathematical Society, vol. 9 (1908). 

§Monatahefte fiir Mathematik und Physik, vol. 15 (1904). 

||Annales de Toulouse, 1908. 

If Since this paper was •written J. Maety has published some results for unsymmetric kernels, 
Comptes Kendus, February 28, March 7, April 25, and June 6, 1910. See also the note by 
the author In Bulletin of the American Mathematical Society, July, 1910. 
Trans. Am. Math. Soe. lo 135 
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Necessary and sufficient conditions for the existence of the adjoint system {wj 
of any system of linearly independent functions { Mj } are deduced (theorem 2, 
§ 3). Theorems for biorthogonal systems analogous to those of EiESZ and 
Fischer for orthogonal systems are : (a) if 



UM 



converges for every function y which is integrable and has an integrable square, 
then for every system of constants { c^ } of finite norm there exists a function g 
such that c^ = J gu. (corollary 1, theorem 6) ; (h) if the system { u. } is complete 
and if certain conditions are imposed on the function g, then (theorem 8) 



J/9' = 15J AJ '«i5'- 



The equivalence of two biorthogonal systems is defined and a classification 
into types is made (§ 7). With each type satisfying a certain condition there 
is connected uniquely (§ 6) and in a reversible way (theorem 20, § 8) a single- 
valued functional transformation * T(f) , which transforms every function which 
is integrable and has an integrable square into a function of the same kind, and 
is defined by the properties 

(1) T{ aj[ + a J,) = a, T{f, ) + a, T{f,), 

(2) /[./;2'(/.)-/.^(/:)]=0, 

(3) JfT{f)^0. 

The class of all orthogonal systems of functions is a special type, for which 
T{f) is the identical transformation. Other special cases of T[f) are 

P{s) I P{^)f{s)ds 



T{f)= C K{s,t)f{t)dt. 

*J a 



ds 



By means of the theorems by Eiesz, Fischee and Toeplitz, it can be shown 
that there is a one-to-one correspondence between this functional transformation 
T(^f) and positive definite limited quadratic forms in infinitely many variables. 

* Linear functional transformations have recently been studied by F. EiESZ, Matbe- 
matische Annalen, vol. 69 (1910), p. 449. 
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§ 1. Fundamental Notations. 

We consider an arbitrary interval /: a^s = h: of the real variable s , and 
the corresponding square S: a = s = h,a = t=h: of the real variables s and t, 
and real functions of these variables. We denote functions of a single variable 
by _/", g , f, (^ , etc., omitting the argument, j^ is the class of all functions f 
such that f and f^ are integrable in the sense of Lebesgue * on the interval /. 
As usual, we regard two functions of '^ as equal if they differ only on a set of 
points of content zero.f We call two such functions " essentially equal." 

When there is no ambiguity we omit the variable of integration In all cases 
the limits of integration are omitted, since / is the only interval of integration 
considered in this paper. 

Constants and functions with the subscripts i, j, h denote sequences of con- 
stants and functions. 

© and ^ denote subclasses of % and the elements of these subclasses are 
denoted by the small letters g and h . 

To express that a relation involving the function g holds for every function 
of the class we write [g) after the relation ; for example 

We use a similar notation in the case of several variables ; for example 

Let {/'. } denote any sequence of linearly independent functions of the class 
^ , and { ^i } the sequence of normalized and orthogonal \ functions which are 
obtained linearly from the functions f^ by means of the construction given by 
E. Schmidt,! 

^jJ(f,-T,<f>,J4>.Ar 

Each <f>^ may be expressed linearly and homogeneously with constant coefficients 
in terms oi f^,/^, — ,f^, and conversely: 

(1) <^i=i: «.*/., A^ihAu (0. 

k--l k=l 



*LEBi!SGtra, Sur VinUgration, p. 115. 
t Lebesgue, 1. c, p. 106. 

X A function / is normalized if / /^ = 1 . Two functions /i and /^ are orthogonal if j /i /j = . 
§ Zur Theorie der linearen und nicMHnearen Integralgleichungen. Mathematische Annalen, 
vol. 63 (1907), p. 442. 
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The constants a.j., h^^ have the following properties : 

««4=0 (O, 

««=0 (fc>i), 

(2) 

&«4=0 (0, 

The matrices formed from the coefficients a^^ and h.^ we denote by (ajj.). and 
(6^j,)^ respectively, or simply by (a)^ and (6)^. 

If { ^^ } are the normalized and orthogonal functions corresponding to 
{f-= \fi } where { \ } are constants different from zero, then ^^ = (j>^. 

§ 2. Preliminary definitions and lemmas. 

Definition. A system of functions of ^ is called complete * for the interval 
/ if there exists no function / of ^, essentially different from zero, which is 
orthogonal to all the functions of the system in the interval /. 

Definition. A sequence of constants { c^ } is oi finite norm if the sum of the 
squares, 

converges, and it has the norm M\i 

i=i 

For any system { ^^ } of normalized and orthogonal functions of ^ we have 
the three following lemmas.f 

Lemma 1. The sequence of constants 



{M} 



is of finite norm for every function /"of ^. 
Lemma 2. If the system { ^^ } is complete. 



j AA = 'tJ /aJ ^J, (A./.)- 



*F. EiESZ, Comptes Eendus, November, 1906, p. 738. 

fE. Schmidt, 1. c, p. 439 ; F. Riesz, Comptes Eendus, March, 1907, p. 615, and April, 
1907, p. 734; E. FiscHEK, Comptes Eendus, May, 1907, p. 1022. 
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Lemma 3. To every system of constants [c^} of finite norm there corre- 
sponds a function y of '^ such that 

and this function y is essentially unique if the system {^j} is complete. 
Definition. A matrix (a^^.) is limited if 

converges for every k, and 



i=l J 



is of finite norm for every system of values of {x.} of finite norm. 

Definition. A bilinear form of the infinitely many variables x. and y. 

is limited if for some positive constant Jf 



E E ^a^iVk 



SM (n) 



for all values of {a;,.} and {y.} of norm = 1 (H, IV, p. 176 *). 

Lemma 4. The matrix of the coefficients of a limited bilinear form is lim- 
ited (H, IV, p. 179) ; conversely, in virtue of a theorem by Toeplitz f a bilinear 
form whose coefficients are the elements of a limited matrix is limited. 

Lemma 5. If the matrix (a.^,) is limited the matrix («j.j) is limited also. 

Lemma 6. The product of two limited matrices is a limited matrix (H, 
IV, p. 179). 

Definition. A matrix («j) is orthogonal if 

<» i 1 j = k 

„ f 1 j = ^ 






Lemma 7. An orthogonal matrix is limited {H, IV, p. 180). If some of 
the elements of the orthogonal matrix are replaced by zeros, the resulting mati-ix 
is limited. 



*The references to the memoirs by Hilbeet in the Gottinger Naohriohten, 1904-1906, 
are denoted by (ff, I, II, • • •, V). 

fE. Schmidt, Palermo Eendioonti, vol. 25 (1908), p. 2; Hellingek and Toeplitz, 
Gottinger Naohriohten, 1906, p. 351, and Mathematisohe Annalen, vol. 69 (1910), 
p. 289. 
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Lemma 8. The value of a limited bilinear form for arguments {'x,^\ and 

{ y^ } of norm 1 is obtained by summation either by rows or by columns {H, 
IV, p. 180). 

Lemma 9. If a., are the elements of a limited matrix, and if a., = a,., 

Ik ' ik lii ' 

then the system of homogeneous linear equations 

has a solution { a;^ } of finite norm when and only when X is a " characteristic 
number," that is, a root of a certain associated equation, and the number of 
linearly independent solutions is equal to the multiplicity of the root {H, 
IV, p. 198). 

Definition. Two systems * ( u^ ) and ("wj of functions of '^ form a hiorthogonal 
system of functions {u^,v^) if a one-to-one correspondence can be established 
between them such that the integral of the product of two corresponding func- 
tions is equal to unity and the integral of the product of two non-corresponding 
functions is equal to zero ; i. e., 



(s) /^^^^•={5 






Each one of the two systems {u^), ("W,) is called an adjoint system of the 
other. 

The biorthogonal system (i^, v^) is complete as to u, v, respectively, if the 
system (u.), (v^), respectively, is complete. 

For a biorthogonal system (m^, v.) the functions u^ and also v. are linearly 
independent. Suppose there existed a linear relation 

c^Ui + c^u^+ ... +c^u^ = 0. 

Multiply by v^{i=l, 2, •.., n) and integrate; from the properties (3) we 
obtain 

C,= (i = l, 2, .•.,«). 

§ 3. Denumerability and existence of the adjoint system. 

Theorem 1. A system (mJ of functions of^ having an adjoint system (v.) 
is denumerable. 

We follow the method used by Riesz t to prove that an orthogonal system of 
functions is denumerable. The proof is based on the following theorem : If for 

* Until after theorem 1 the suhscripts i and j are used to denote not only sequences but any 
system of functions. 

tComptes Bendus, November, 1906, p. 738. 
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every sequence {y^} of linearly independent functions selected from a given 
system 

then the given system is denumerable. 

Without loss of generality we may assume that 

/«' = ! (•")• 

Let {u.} be any sequence of distinct functions selected from the system ( m^ ) 
and let v^ be the corresponding functions of the adjoint system. By Bessel's 
inequality we have 

The hypotheses of the theorem are satisfied and the system (Wj) is denumer- 
able. When the system (m^.) is complete it cannot be finite, and is therefore 
denumerably infinite. 

Let {(fi) and { -i/r^. } be the systems of normalized orthogonal functions con- 
structed linearly from the functions { u^ } and {v.] , respectively, of the biorthog- 
onal system (m^., v^). Connected with these systems of functions we have the 
four matrices (a^, {h\, («)„, {h\. (§1.) 

Theorem 2. The necessary and sufficient condition that a given system of 
functions [u^] of^ have an adjoint system is, that the a.^ of [a\ he of finite 
norm for every h. 

Suppose the condition is satisfied ; then from lemma 3 follows the existence 
of a system of functions { v. } of j^ such that 

(4) ««=/fi^. ('.«^)- 

The equations connecting { m^ } and { (p^ } are 

i 
k=\ 

and 

i 

(6) W=E^-;tfi- 

k=\ 

Multiply the equation (6) by v. and integrate: 
By substitution from the equation (4) : 

i 

•i.v.= y^.b.,a,... 



/• 
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Since the matrices ( J^j) and («j.) are each the inverse of the other we obtain 



fu,v^.= [ 










Thus by definition the system {v.} is an adjoint system of { w,- } . 

Suppose conversely that an adjoint system {v.} exists. Multiply the equa- 
tions (5) by ■Wj. and integrate 

Applying lemma 1, we see that the condition is necessary. 

Example. Let u^ = s'~' ,a= — 1,6= + 1. Since the Legendrian poly- 
nomials P^ ( s ) form an orthogonal system of functions for the interval ( — 1 , 
-f 1), and since -f*i(s) is linear in 1, s, s^, •••,«', it is clear that the functions 
f^ defined by the equations (6) are the Legendrian polynomials multiplied by 
the proper constants. The value* of cs^to, i is given by 



Hence 



_ 4m-f 1 1 -3 .5 ...(2wi — 1) 
«2m, 1 = ^ 2 2 . 4 ... 2m • 



2 4m + 1 2 



2{2m + 1) tt" 



And the constants { a^^ j } cannot be of finite norm. This is sufficient to show 
that the system of the powers of s has no adjoint system in the interval 

§ 4. Limited matrices. 

Lemma 1, § 2, can be extended to biorthogonal systems only when certain 
conditions indicated in the following theorem are satisfied. 

Theorem 3. If {f^ } is any sequence of linearly independent Junctions of^, 
the necessary and sufficient condition that the sequence \ f Jf. > be of finite 
norm for every function f qf^ is that the matrix (6)^ be limited. 

Multiply the second equation of (1) by any function y of '^ and integrate : 

By lemma 1, {j ^j,/^} is of finite norm for every f oi "^j and therefore 
{fffi} is of finite norm for every y of ^ if the matrix (6)y is limited. 
On the other hand, if 

{///•} 

* Bybely, Fourier's Series, pp. 180 and 70. 
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is of finite norm for every y, then 

is of finite norm for every {x^} of finite norm because 

lffi=T, K^u^ 

where y is the function of j^ which by lemma 3 corresponds to {x^] . 

Remark. We can always multiply the functions {f^} by constants \ =4= ^ 
so that 

{\Sff] (-^^ 

is of finite norm. This is evident since it follows from BesseFs inequality that 

Corollary 1. If {y } is any sequence of linearly independent functions of 
"^ , the necessary and sufficient condition that the sequence | jXfi I ^® ^^ finite 
norm for every function y of ^ is that 

where Mis a, constant depending only on the sequence {/{}• 
This is a consequence of the property of a limited matrix that 

i k 

where Jf does not depend on J^x\ (lemma 4). 

Corollary 2. If { «,. } and { v^ } form a biorthogonal system of functions, 
the necessary and sufficient condition that {jfuA, {//*>,■}, respectively, be 

of finite norm =M ^ f^ for every function / of g^ is that (6)„, (&)„, respec- 
tively, be limited. 

Theorem 4. If the biorthogonal system (u., v.) is complete as to u, v, 
respectively, the necessary and sufficient condition that | J /v. |- , Ij fu^ \ , 
respectively, he of finite norm for every function f of "^ is that the matrices 
{a\, {a\, respectively, be limited. 

We prove the theorem for the case that { u^ } is complete. From the equa^ 
tions (6) it is clear that the system {^J is also complete. Applying lemma 2 
and the equations (4) we obtain the following equations : 



(7) ffv,= ia,Jf,f 



{i,f)- 



144 A. J. PELL : BIOETHOGONAL SYSTEMS OF FUNCTIONS [April 

The remainder of the proof is precisely the same as for theorem 3. 

Corollary. When the biorthogonal system (?/p v^) is complete as U) u, v, 
respectively, a limited matrix («)„, {<i\-, respectively, implies a limited matrix 
(5)^, (&)„, respectively, and conversely. 

Theorem 5. If {f^} is any sequence of linearly independent functions of 
^ , the necessary and sufficient condition, that for every sequence of constants 
{c^} of finite norm there may exist a function f of ^ such that 

is that the matrix {aYbe liinited. 

Multiply the first set of equations (1) by an arbitrary function f oi ^ and 
integrate : 

(8) jf<i>i-i<^..j f,j (')• 

Suppose first that the matrix ( a ). is limited ; then the sequence of constants 
is of finite norm and there exists [lemma 3] a function _/of '^ such that 

)/</'; = E«i*C, (0- 

Taking into consideration the properties (2), § 1, it is clear from the equations 
(8) that 

We now make the assumption that to every sequence of constants { c^ } of 
finite norm there corresponds a function foi'^ such that 

<'. = //./ (0. 

By means of the equations (8) and lemma 1 we find that 

i 

is of finite norm for every sequence { c^ } of finite norm, and thus by definition 
the matrix (a) is limited. 

If the system [f } is complete, then 
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Corollary. If { w^ j and [v^] form a biorthogonal system, the necessary and 
sufficient condition, that for every sequence of constants { c^, } of finite norm 

there exists a function f oi "^ such that for every ^, c^ = Ju. J, c. = J v^f^, 

respectively, is that the matrix («)„, («),, respectively, be limited. 

Theorem 6. ^ [u^} and {v^} form a biorthogonal system of functions, 
a limited matrix (5)„, (^)„) respectively, implies a limited matrix (a)„, {(i)„f 
respectively. 

We give the proof for a limited matrix ( 6 )„ • The matrix (i\ is formed 
from the coefficients in the equations 



Multiply these equations by ^^ and integrate : 
(9) a,, = ±hj^^ 



rjrk 



( f, fc) , 



where by equations (4) a^^ are the elements of the matrix ( a^. )^ . The matrix 
(a^.^)^ is the product of the two matrices (&••)„ and (J "^f,, ) which are both 

limited (lemma 7), and is therefore (lemma 6) itself limited. 

For a biorthogonal system (u., v^), the functions u^ can be multiplied by con- 
stants X^ =[= so that the resulting matrix (ffi)x„ is limited. 

Corollary 1. If { m. } and {v^} form a biorthogonal system such that the 

sequence {jfVf \ is of finite norm for eveiy _/ of j^, then for every sequence 
of constants { c^ } of finite norm there exists a function gloi ^ such that 



c. ■ 



fff^i- 



Corollary 2. When the biorthogonal system (^u., v.) is complete as to u, 
the elements of the matrices (a)^ and (h\ are connected by the relations 

(10) E< = Z^« (o. 

A similar relation exists between the elements of the matrices (a)^ and (h\ 
when the biorthogonal system is complete as to « . 

We give below four examples to illustrate the different cases which may arise. 

Example 1. Let { ^^ } be a system of normalized orthogonal functions for 
the interval I, and { a^ } a system of constants such that | «; | = -S^ where If is 
some finite positive quantity. Then { u^ } and {v.} , defined by 



Mo 



-1=<^2/-1' % = 'l>2J + (^Aj-l' ^•-l = <^2,-l-«,<^2/' '"%-=<^2,' 
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form a biorthogonal system (u., v^) whose matrices (&)„, (6)„ and therefore 
{(t)„, ( 0! )„ are limited. 

Example 2. The same biorthogonal system as in example 1, except that the 
constants { a^ } are such that {\ja^] is of finite norm. In this case neither of 
the matrices {i)^ and ( & )„ is limited. 

Example 3. Let { <^j } be a system of normalized orthogonal functions for 
the interval /: {a.} a, sequence of constants such that {\|a^} is of finite norm. 
For the biorthogonal system (m^, v^) defined by the equations 

Ui=a.cj>. (0, 

t 

the matrix ( 6 )^ is limited, but the matrix ( 6 )„ is not. 

Example 4. The systems { <fi^ } and [a.] are conditioned as in example (3). 
For the biorthogonal system (u^, v.) defined by the equations 

«i = ^2i-l + «i'^2i (0, 

the matrix ( a )^ is limited but the matrix ( 6 )„ is not. In this example the 
matrices (a)^ and ( 6 )^ are also limited but the system {u^} is not complete : 
compare with theorem 4. 

§ 5. Convergence and evaluation of 

Definition. For the biorthogonal system [u^, v.), @ is the class of all func- 
tions g for which there exists a system of constants { /^j 4= ^ } such that 
{ l^ij 9'^i } ^^ ^^ finite norm, and | J fv./fif | is of finite norm for every 
function / of ^ . 

Example. For the biorthogonal system given in example 2, § 4, the class 
@ is the class of all functions g such that | c.J gu^ \ is of finite norm, where 
c^._^ = a^, Cj; = 1. It is evident that the matrix (6),,/^ is limited. Any other 
system of constants {fi.} which would make {b\i^ limited is such that the 
ratio cJ/M^ is less than a fixed constant for every i , and therefore for any function 
g such that | fi.j gu. J- is of finite norm, the sequence | c.J gu. | is also of finite 
norm. 

When ( 6 )^ is limited, @ contains the class of all functions g oi "^ such that 
1 J 9^i } ^® ^^ finite norm. 



1911] A. J. PELL: BIORTHOGONAL SYSTEMS OF FUNCTIONS 147 

Definition. For the biorthogonal system (m^, v.), ^ is the class of all func- 
tions h for which there exists a system of constants [ i^^ =^ } such that I v.jhv\ 

is of finite norm, and I J f'>^i/Vf } is of finite norm for every function f oi '^. 

When ( h )^ is limited, ^ contains the class of all functions A of ^^ such that 
{jh'oA is of finite norm. 

In the definition the function g is assumed to belong to the class ^, but any 
function g satisfying those conditions must belong to % since the matrix (6 )„,^ and 
therefore the matrix {a)^^ corresponding to g is limited, and by the equations 
(6), U gf^ I is of finite norm and therefore g belongs to g^. Similarly the func- 
tions A must necessarily belong to ^. 

Theorem 7. If {u^, v^) is a biorthogonal system, then for every function g 
of @ and for every function fof^ the expression 

is convergent ; and for every function h of ^ and every function f of '^ the 
expression 

'E.JfUij v.h 

is convergent. 

The convergence follows directly from the two inequalities : 

(|:/..,/»,/)"s| (.,/..,) Sl'^')' '^•"• 

Theorem 8. When the biorthogonal system (m^, v^) is complete as to u, or 
when the functions v^ and g are orthogonal to the functions which together with 
the u.form a complete system, the integral I gfmay be represented as follows : 



(11) ffff==±f9ujv,f 



if, 9); 



when it is complete as to v, or when the functions u. and h are orthogonal to 
the functions which together with the v^ form a complete system, the integral 
J hf may similarly be represented : 



(12) J¥-tJ.f^^Jv,h 



(/,/«) 
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We give the proof for the first part of the theorem. 

From the definition of @ the matrix ( i )j,,^ is limited, and therefore by theorem 
6 the matrix (a^„ is limited. 

The elements of the limited matrix (a)^^ are oj^j./Mj- Consider the bilinear 
form 



Make the substitution 



Since 









(k) 



Since 



we obtain from summation by rows 

k=l J J 

J k=i Pi J 

we obtain from summation by columns 

Z J gfij fif- 

By lemma 7 these two sums are equal, and applying lemma 2 we have the desired 
result : 

Corollary 1. When the biorthogonal system (m^., «^) is complete as to m, 
then 

(13) fff' = tfff^J^.9 io) 
when it Is complete as to « , then 

(14) J¥ = j^Jhu,jv.h ih). 

These relations do not necessarily hold for every function y of ^ unless 
@ = (^ and ^ = ^, respectively. This is illustrated by the example at the end 
of this section. 
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Corollary 2. If the function p is orthogonal to all the functions v^, u. 
respectively, then it is orthogonal to all the functions of the classes ©, ^ 
respectively. 

Corollary 3. If the biorthogonal system (-y^, u.) is complete as to u, v, 
respectively, and the function p is orthogonal to all the functions v^, u., respec- 
tively, then the matrices ( 6 )^ and ( 6 )^ cannot both be limited. 

Theorem 9. When the biorthogonal system (w,, v^) is complete as to u, v 
respectively there exists no function in &, ^, respectively, essentially different 
from zero which is orthogonal to the system {v.}, {U{}, respectively. 

This is an immediate consequence of the equations (13) and (14). 

Corollary. When @ = g, ^ = g, respectively, a complete system {u^}, {v^ } 
respectively, implies a complete system {v.}, {u^} respectively. 

Theorem 10. If the hiorthogonal system (u., v^) is complete as to u, v, 
respectively and the functions u., v^, respectively, belong to the class &, Q, 
respectively, then the system {v-} , {ii.} respectively is also complete. 

A function y of ^, orthogonal to the functions v., would be orthogonal to the 
functions {u.} also, as is seen from the equations (11). 

The following example is that of a biorthogonal system (m^., v^) complete as 
to u but not complete as to ■« . 

Example. Let { 0; } form a complete system of normalized orthogonal func- 
tions, and let ^ =1= be a function belonging to g^ but linearly dependent on no 
finite number of functions 0^ and therefore 



Construct the functions 



(15) 



p fpu^ 

JP 

The functions u. and v. form a biorthogonal system (m^ v.) complete as to u 
but the function^ is orthogonal to all the functions v^. The functions v. form 
a system of orthogonal and normalized functions and therefore the matrix ( 5 ) 

is limited. The matrix (b\is not limited ; otherwise fp^ could be expressed by 

J p^ = T,j p^ij %p^ 

which is impossible. 
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This construction could be generalized, so that the system {u.} would be 
complete and all the functions v. orthogonal to a finite number of functions 

§ 6. Associated functions. 

Definition. The function f is a vu-associated function of the function f 

with respect to the biorthogonal system (^u., v^) if it satisfies the following 
relation : 
(16) ffv^=fuj^ (i). 

Remarh 1. If the system {u^\ is complete, thenj^j is the only ww-associated 
function of y, and for a function p orthogonal to all the functions v^ the wtt-asso- 
ciated function is zero, and the function y + MP , where \x is an arbitrary constant, 
has the same wM-associated function asy. 

Remark 2 . The functions v. are ww-associated functions of m,- . For an 
orthogonal system a ■UM-associated function is the function itself. 

Remark 3. The sum of two functions, which are uM-associated functions of 
two given functions, is a ww-associated function of the sum of the two given 
functions. 

Definition. The function y is a uv-associated function of the function y with 
respect to the biorthogonal system ( u^ , v.) if it satisfies the following relation : 

(17) SU\-hJ (0. 

Remark 4. A statement of the immediate consequences of this definition is 
obtained by interchanging u and v in the remarks (1), (2), and (3). 

Theorem 11. If the hiorthogonal system [u., v^) has a limited matrix (6)„, 
(h)^, respectively, then for every function f qf^ there exists a vu-associated g 
which belongs to (B, a uv-associated function h which belongs to ^ , respectively. 

This theorem is a consequence of the theorems 3, 5, and 6. Take any 

function y of ^ and let c^ = I fv^ ; by theorem 3, the sequence { c,. } is of finite 
norm, and by theorems 6 and 5 there exists a function ^ of @ such that 



c, = /A = /' 



(<). 



Corollary. If the biorthogonal system (m^., v^) has a limited matrix (b), 
then for every function f of ^ there exists a ww-associated function when and 
only when the matrix (6)^^ is also limited. 

Theorem 12. If for a biorthogonal system, comp)lete as to u, the vu-asso- 
ciated function g exists for every function f of '^ , then the matrix (b\ is 
limited. 



(/). 
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This theorem is a consequence of lemma 3 and the equations (5) and (7). 
Multiply the equations (5) by g and integrate and then substitute from the 

equations (7) for J gu^. By lemma 3 the matrix C^u.j^u.j^) is limited and by 
reason of the properties (2), § 2, it follows that (a)^ is also limited. Corollary 
to theorem 4 shows that (6)^ is limited. 

Theorem 13. If the hiorthogonal system (m^, v^) is complete as to u mid 
has a limited matrix (6)^, and if g is the vu-associated function off, then the 

integral J fg can be expressed as the sum of squares : 

This follows from a direct application of the theorem 8 and equations (11). 

Semark. If the hiorthogonal system (w^, v.) is complete as to u and has a 
limited matrix ( S )^ and if g is the ■yw-associated function of some function f, 
and the function p is orthogonal to all the functions v. , then p is also orthogonal 
to g. This is a special case of the corollary to theorem 8. 

Theorem, 14. If the hiorthogonal system (u^, v^)is complete as to u and 
has a limited matrix (6)„, a7id if gi is the vu-associated function off, and g^ 
that off^, then 

(19) IJ\g, = j'Ag, (/i-/^)- 

This is a consequence of theorem 8. 

If the hiorthogonal system (^u^ , v^) has a limited matrix (6)„, then by theorem 
11 the «M-associated functions define a functional transformation T, 

(20) 9=T{f) if), 

which is applicable to the class ^, and is single- valued if the system {u^ } is 
complete. 

A particular case of equation (20) is 

(21) «, = n«J (0. 
When the system {u.} is complete, Tis linear: 

(22) T{aJ[+aJ,) = a,T{f) + a,T{f) {/„/,). 
In terms of :7'the theorems 14 and 13 may be expressed as follows: 

(23) f[fnf)-fnA)]=o (A,/.) 

and 

(24) ffT{f)^0 (/), 

the equality sign in (24) holding only fory== or T{f) = 0. 

Trans. Am. Math. Soc. 11 
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We give below some examples of this functional transformation T. 
Example 1. For a complete orthogonal system T(yj^ ) =/". 
Example 2. For the complete biorthogonal system 

where a is a positive function of ^ , the transformation T is 

Example 3. Let ( m^ . v.) be the biorthogonal system defined in the example 
in § 5. The transformation T is given by 

Jp 

Example 4. Let ir( s, t) be a kernel which is continuous, symmetric, has 
positive characteristic numbers { Mj ] , and for which there exists no function 
f in ^ such that j K{s, t)J'(t)dt= 0. Let the characteristic functions 
be{0,j: 

The biorthogonal system 

is complete as to m, and has a limited matrix ( 6 )_^ because the sequence of num- 
bers { l/iJ-i } is of finite norm. The functional transformation Tis 

g{s) = jK{s,t)f{t)dt. 

§ 7. Equivalent hiorthogonal systems. 

Definition. The biorthogonal systems (mj, w^) and (^v^, Vi) complete as to 
u and M, respectively, and satisfying the relation 

are called equivalent. 

As a trivial case, all orthogonal systems are equivalent. The definition may 
be applied to some biorthogonal systems which are not complete. 

Theorem 15. If the hiorthogonal system [ui,Vi) is complete as to u and 
has a limited matrix ( 6 )„, then two biorthogonal systems (^u^, v,) and (m; , ¥; ) 
each equivalent to (m^, U;) are equivalent to each other. 

This follows directly from the equations (19). 
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Theorem, 16. If the hiorthogonal systems (uf , Vf ) and (uf , Vi) are complete 
as to u and u respectively, and if the matrices ( 6 )„ and {h)^ are limited, then 
the necessary and sufficient condition that the matrix J u^v^ he orthogonal, is 
that the two given systems he equivalent. 

If the two systems are equivalent, the conditions for the orthogonality (§ 2) of 
the matrix J ili v^, are satisfied : for 






4 '"'• 

'4 "•''■ 



i , 
To prove the converse, let v. be the tJ?<-associated function of u. . Then 

fu,v,= tJu,vJu,jS^^tf^.v,fv,n,= {l ]='. 

and therefore 

fu.Vj = fv/t, (i,j). 

Since the system { M; } is complete we obtain 

'Vi = Vi (i) 

and the two systems are equivalent. 

Theorem 17. If the hiorthogonal system («,-, v^) is complete as to u and 
the matrix ( 6 )^ is limited, then for any hiorthogonal system ( «,- , tj^ ) complete 
as to u and equivalent to the system (u^, Vi) the matrix (&)„ is limited. 

Letybe any function of ^ and write the equations 






(i). 



From this system of equations we see that {ffvi | is of finite norm for every 
_/ and therefore the matrix (h)^ is limited. 

Theorem 18. Jf the equivalent hiorthogonal systems (u^, Vi) and (m,-, Vi) 
are complete as to u and u respectively, and the matrices (h)^ and (&)„ are 
limited, then the vu-associated function g of any given function f is equal to 
the vu-associated function g off. 

We have 

r-_ C^- ^ C^ C - ^ C C - C - 

J J lc=lJ J k=l J J J 

Since the system M; is complete, g = g. 
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Corollary. The functional transformations T and T, corresponding to two 
biorthogonal systems (m^, Vi) and (m,-, Vi) which satisfy the conditions of 
theorem 17, are equal. 

Remarh. If two biorthogonal systems have the same functional transforma- 
tion T, they are equivalent. 

§ 8. Functional transformations T. 

In this section we consider functional transformations T, which transform 
every function of ^ into a function of "^ and which are single- valued and possess 
the following three properties : * 

(22) T{^J, + aJ,) = a,T{f,) + a,T{f,) {a„u,,A,A), 

(23) S[AnA)-AnA)']=^ (f^^f^)' 

(24) ffT(f)^0 (/), 

the equality sign in (24) holding only for/'= or T{f) = 0. 
Theorem 19. Any biorthogonal system (m^, v^) such that 

^i = T{u,) (O, 

where T has the three properties (22), (23), (24), has a limited matrix (h)^. 
Let / be any function of ^ ; then by the property (24) 

j{f-i^uj^,T{f))[T{f)-i%j^,f)^^ ('./)• 

Transforming this inequality, we obtain 

(25) t[fv,jJ^ffT{f) (i,f), 

and therefore the matrix (6)^ is limited. 

Corollary. For any two functions /"j and^/j of 3^, 

(26) (//.^(/2)> = //.^(/i)//.n/.) (/!./.)• 
In the inequality (25) make the substitution i = l,f=f^, and 

' jAT{fS 

where f and f are any two functions of j^, such that Ti^f) ^ and 
*Since Tig single-valued, the linearity (22) is a consequence of (23). 
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Theorem 20. For any functional transformation T which has the three 
properties (22), (23), (24), and vihich does not transform every function into 
zero, there exist hiorthogonal systems (u., v.) for which 

v,= T(u,) (i). 

Let { /] } be any sequence of linearly independent functions of g^ , for which 
T( /i ) 4= and also are linearly independent. Construct the following system : 



k=\ 'J 



(27) 



nA)-T.vJ%f, 

0^ = — = . ^ 



(i), 



For j = 1 it is clear that the denominators do not vanish and that v.= T(^u^). 
Assume that the statement is true for i — 1; then 

and therefore by (24) the denominators of u and v cannot vanish unless 

or 

Either one of these equations is contrary to the hypothesis on I,/,}. Therefore 

Vi=T(Ui) (i). 

It can now be argued that the systems { Mj } and { V; } form a biorthogonal 
system. It is easily seen that the relations 



J Mi^',■=|-^ 






hold for i , J = 1 , 2 . Assume that they hold for i , _/ = 1 , 2 , • • • , w — 1 and 
prove that they then hold for i,j ^1, 2, • • •, n. 

Since in a biorthogonal system (m^, w,) the functions Ui and also w^ are 
necessarily linearly independent, the vanishing of the denominator of m^ and «,- 
gives a sufficient condition that {fi} and {^(/i)} be linearly dependent. 



156 
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The biorthogonal system (m;, v^) defined by the equations (27) has by 
theorem 18 a limited matrix ( 6 )_,; a t)M-associated function gf of any function 
/"exists and 

ff=nA)- 

Biorthogonal systems constructed from different sequences {f^ } are equivalent 
or belong to the same type. 

There exist functional transformations T with the properties (22), (23), (24) 
for which there does not exist a complete system of linearly independent func- 
tions {Ai] such that the functions T{fi) are linearly independent. For 
example, the functional transformation 



T{f)^fK{s,t)f{t)dt, 



where 



K{s,t)=j: 



4>i{^)<t>i{t) 



Mi 



transforms every function f into a linear combination of the n functions 4>i 
( i = 1 , . . • , w ) . If, however, there exists a complete system of linearly 
independent functions {Ai} such that the functions T(fi) are linearly inde- 
pendent, then a biorthogonal system can be constructed by (27) which is com- 
plete as to M. In all cases however, 



j 9f=^j Sf^ij ""iA- 



Theorem 21. A single-valued functional transformation T which has the 
three properties (22), (23), and (24), and for which there exists a complete sys- 
tem of linearly independent functions {f } such that T{fi ) are also linearly 
independent, is equivalent to a type of biorthogonal systems (m^, ■u^) complete 
as to u and with limited matrices (6)„. 

The formulae for u'- and v^ may be expressed in the following form : 





JATU\) jA^nf,) . 
jA^TiA,) SA.T{A.) ■ 


■■ JA,T{A-.) A 
■■ jAnA-.) A 






jy.Tif) fATif) ... fAnA-^) A 






\fAnA 
lAnA 


)fAT{A)---fAT{A-^) 
)fAT{A)---fAT{A-,) 

\)SA,-J{A)-If.-.T{f-d 


f AT{A)f AAA)- 
fAT{A)fAnA)- 

j'AnAdffi^iA) ■ 


■jATiA) 
■■lATiA) 

■■fAn/,) 



(i), 
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lAnA) lATiA) •■■ 
SAnA) lA^A) ••• 


fA-^nA) nA) 
jA-.nA) nA) 








j'AnA) lATiA) ••• fA-^nQ T{A,) 




''^i 


fAnA)fJ.nA)■■■SA-^T(A) 


SAT{A.)SfJ{A)---SmA) 


V 


SAT{f.-dIf.T{A-d- ■■SA-,T{f,_d 


Sf.nidJf.Tif.)- 


••SfiTUd 



(i). 



The necessary and sufficient condition that both the systems [f^] and {T{f^ } 
be linearly dependent is the vanishing of the determinant 



(28) 



//i2-(/>) JAT{A) ... ff,T(A) 

fAn/r) lAnA) ■•■ jAnA) 



Theorem 22. If, for a Aunctional transformation T with the properties 
(22), (23), and (24), there exists aAunction p such that p = \T(p), then there 
exists a hiorthogonal system (u^, v,) for which the vv^associated function g of 
a funxition A orthogonal to p is given hy 

9=nA). 

Taking into consideration the inequality (26) and the condition imposed on 
p , we see that the functional transformation 

pJpTiA) 



T{A)-nA) 



I 



p' 



satisfies the three conditions (22), (23), and (24). By theorem 20 we can con- 
struct a hiorthogonal system ( u^ , v^ ) such that 

v,= f{u,). 
The «M-associated function g of /"is given by 



/ 



P 



If 
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and therefore if_/j is orthogonal to^, 

§9. Solutions off =\T{J). 

Let y be a single-valued functional transformation which transforms every 
function of ^ into a function of '^ and which has the properties (22), (23), and 
(24) ; and let (m^ , v^) be a biorthogonal system (theorem 20) for which 

Then the matrix (6)^ is limited (theorem 19) and therefore also the matrix («)„ • 

The matrix ( a^ ^ ) , where 

t» 

a.. = y^ a.a,., 

is limited, by lemma 6, and is symmetric. 

In this section we consider the functional equation 

(31) f=^T{f), 

where X is a parameter, and / a function to be determined. 
Theorem 23. If there exists a solution f of the equation 

f=^nf), 

then 

is a solution of finite norm of the infinite system of homogeneous linear equations 

(32) z,-\±a^,z, = (i (i), 

and conversely a solution of finite norm of the equations (32) leads to a solution 
of the equation (31). 

The functional equation (31) is equivalent to the set of equations 

(33) ffu,=\fvj (i). 

By means of the equations (5) and (7) we obtain the result that the equations 
(33) are equivalent to (32). 

Corollary. The functional equation (31) has a solution / when and only 
when the quadratic form S'^ij^j^'j, has a characteristic number ; the number of 
the solutions / depends on the multiplicity of the characteristic number. 

This corollary follows from lemma 8. 
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Theorem 24. Two solutions of 

corresponding to two different values of X , are orthogonal. 

Let the two values of X be X^ and X^, and the corresponding solutions _/j 
and f : 

f = \T{f), f,^\T{f). 

Multiply the first equation by/j and integrate. By means of the second equa- 
tion and (23) we obtain 

and therefore 

when Xj and X^ are distinct. 

If the kernel K{s, t) is symmetric, positive semi-definite, and satisfies cer- 
tain continuity conditions, the integral equation 

f{s) = \jK{s,t)f{t)dt 

is a special case of the functional equation (31). This integral equation has at 
least one solution, the multiplicity of a characteristic number is always finite, 
and if there are an infinite number of characteristic numbers the limit point is 
infinite. 

We give examples in which the spectrum* of the quadratic form ^ '^u^XiX,, 
consists of a point spectrum with finite or infinite multiplicity, or with a finite 
or infinite limit point, or of a continuous spectrum. 

Example 1. Same as the example in § 5. 

The spectrum consists of the one point unity with an infinite multiplicity. 
Any function orthogonal to ^ is a solution of the equation (31). 

Example 2. Let {4>i} be a complete system of normalized and orthogonal 
functions ; and let ( m^ , t)j ) be the biorthogonal system defined by 

i 

'Oi = <t>i — ^i+i (0- 

The quadratic form 2 ^ik^i'^h becomes 

GO 00 

a!? + 2 2 «? — 2 X a;j «;+! 

1=1 i=\ 



*H. IV, p. 172. 
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and its spectrum * is a continuous spectrum consisting of the values X between 
+ 1 and + 00. The equation (31) has no solution / belonging to j^. 

Example 3. Same as example 1, § 4, in which the constants a; approach 
zero as a limit, and the functions 4>i are complete and continuous. 

The spectrum consists of a point spectrum with limit point at 1 : 



2 + «| + aj v/aj + 4 
S-i = 2 ' 

(i). 

X ^ 2 + a| - g,. Vaj + 4 



ij 2 

The corresponding solutions of (31) are 



a„. , ^ 






"''' (l-\)^ + «; 



The functions { «i } form a complete system of normalized orthogonal functions. 
It is possible to take a^ so small that 



K^s,t)=±:^^ 



l-x, 

converges uniformly ; 1/1 — X^ are then the characteristic numbers of K{s, t). 
With this restriction imposed on a^ , we obtain for any function / and its vu- 
associated function g 

f{s) = g{s)-fK{s,t)g{t)dt. 

Since 1 is not a characteristic number of K(s, t) we can solve this equation for 
g and obtain for T 

g{s)=f{s)-fk{s,t)f{t)dt, 

where k(s, t) is the resolvent of K[s, t). The first equation gives the rela- 
tion between any function g and its wti-associated function /. 

Example 4. Same as example 1, § 4, in which however the constants a^ are 
all equal to the constant a, the system {4>i] is complete, and the functions <^^ 
are continuous. 

In this case the spectrum consists of the two points : 



2 + «' + «!/«' +4 1_2 +a2-aT/a2 + 4 



* H. Weyl, Singuldre Integralgleichungen, Dissertation, Gottingen, 1908, p. 69. 
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each of infinite multiplicity. Let the solutions of (31), corresponding to I and 
1/^, be {a^} and { «< } respectively. Each of these systems we may consider 
as orthogonal and normalized ; and each system is orthogonal to the other. 
Further, the two systems together form a complete orthogonal system of con- 
tinuous functions ; and it is possible to choose systems of constants {li} and 
{ Z* } such that they are the characteristic numbers of two symmetric kernels 
J^{s, t) and IC*(s, t), whose corresponding characteristic functions are the 
{ a^ } and { a' } respectively. Then the functions u^ and v^ satisfy the equation 

/ [IC{s, t) + lK\s,t)]Ui{t)dt==f[lir{s, t) + ir''{s, t)']vi{t}dt (i). 

This is an integral equation of the first kind in both Uf and Vi . The functional 
transformation is given by* 

where 

and ^^^*+^>(s, t) and ^*f^*+^'(s, t) are iterated kernels of IT and K* respec- 
tively. 

§ 10. Complete -f elementary theory of six properties. 

A biorthogonal system (u., v.) may have one or more of the following six 
properties: 1) { m,- } complete; 2) { «,• } complete; 3) («)„ limited; 4) (6)^ lim- 
ited ; 5) (a)^ limited ; 6) (6)^ limited. If we consider all the possibilities of a 
biorthogonal system possessing or not possessing each one of these six properties, 
there are 2* = 64 cases to be considered. To establish a complete elementary 
theory we must, for each of the 64 cases, either show by theorems the impossi- 
bility of the case or exhibit an example. In this way we show that there are 
no general theorems relating to these six pi-operties other than those already 
obtained. 

Theorem 25. There are no other theorems which are analogous to the corol- 
lary to theorem ^, theorem 6, and corollary S to theorem 8, and which express 
interdependence amo7tg the six properties mentioned above. 

To denote that a biorthogonal system possesses or does not possess the iih 
property (t = l,2, ...,6)we write -f or — in the ^th place. 

Since by theorem 6 a limited matrix (&)„, (&)„ respectively implies a limited 
matrix ( a )„ , (a)^ respectively, the following cases are excluded 

(±, ±, -, ±,±, +), 

(d=,±, ±, -f, -, d=), 
of which 28 are distinct. 

*H. Batkman, Inversion of a definite integral, Mathematisohe Annalen, vol. 63 (1907). 
t E. H. MooEE, Introduction to a form of Qeneral Analysis, The New Haven Mathematical 
Colloquium, p. 82. 
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The corollary to theorem 4 excludes the eases 

(±, ±, +, ±, d=, -), 

(±, ±, =t, -, +,±). 

Of these there are 11 cases which are new and distinct. 
Corollary 3 to theorem 8 excludes the two cases 

( + ,-,+,+,+,+), 

(-, +, +, +, +, +). 

There remain 23 cases, for which we exhibit examples. Two cases which 
differ only by an interchange of u and v may be considered as one case. 

1) (+,+,+,+,+,+)• 

Example 1 in § 4, in which the system { 4>i } is complete. 

This example shows the impossibility of a theorem to the effect that a 
biorthogonal system complete both as to u and v cannot have all the matrices 
limited. 

2) (+,+,+,-,-,+), 

3) (+,+,-,+,+,-). 

Example. 3 in § 4, in which the system {4>^} is complete. 

4) (+,+,-,-,-,-). 
Example 3 in § 4, in which the system {(f>.} is complete. 

5) (-,-,+,+,+,+)• 
Example 1 in § 4, in which the system {</>;} is incomplete. 

6) (-,-,-,+,+,-), 

7) (-, -, +, -, -, +)• 
Example 3 in § 4, in which the system { <^^ } is incomplete. 

8) (-,-,-,-,-,-). 
Example 2 in § 4, in which the system { ^^ } is incomplete. 

9) (-,-,+,+,+,-), 

10) (-,-,+,-,+,+). 

Example 4 in § 4, in which the system {(f>i} is incomplete. 

11) (-,-,+,-,-,-), 

12) (-,-,-,-,+,-). 
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Examples for the cases 20) and 21) below, in which the functions u^ and v^ 
are omitted. 

13) (-, -, +, -, +, -). 

{4>^) is an incomplete system of normalized orthogonal functions. { «i } is a 
sequence of constants such that {1/a^} is of finite norm. {\} is a sequence 
of constants such that {1/X^} is of finite norm and also {\/a^} is of finite 
norm. The biorthogonal system 

u, = X. (^,._j , t,. = ( <f>^._^ + a. 4>^. ) - ( i ) 

clearly has a limited matrix ( a )^ and unlimited matrices (i)^ and ( 6 )^ . That 
the matrix ( «)_, is limited follows from the fact that, for the biorthogonal system 

(u.,v.): 

X.<f>,. 
«.= ---, v, = v, (0, 

i 

the matrix (6)- is limited. 

14) (+, -, +, -, +, +), 

16) (-,+,+,+,+,-)• 

Example in § 5, 

16) (+, -, +, -, -, +), 

17) (-, +, -, +, +, -). 
The biorthogonal system is given by 

U, = \.U., '"i = j^ ('■)' 

i 

where (u., v^) is the biorthogonal system in the example in § 5, and the 
sequence { 1 /\ } is of finite norm. 

18) ( + ,-,-,+,+,-), 

19) (-,+,+,-,-,+). 
The biorthogonal system is given by 

where (m., v.) is the biorthogonal system in the example in § 5, and \ are 
chosen so that ( & )„ is not limited and ( 6 )^ is limited. 

20) ( + ,-,-,-,+,-), 

21) (-,+,+,-,-,-). 

The biorthogonal system is given by 

w. — p _ 

u, = \ , V, = X,v, ( J ) , 
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where (u., v.) Is the biorthogonal system in the example in § 5 and the X^ are 
constants such that { l/\} is not, but { 1/X^ } is, of finite norm. 

22) ( + ,_,_,_,_,_), 

23) (_,+,_,_,_,_). 
The biorthogonal system is given by 



-V ( J i'' - E J p^,J ^kpj y J p'- g J p^,J ^/.p j 



U. = — , , ^ ■ ^~7~ ~~T~=— ( * ) . 



where 



u, 



= «,• ^2,- ' S-+I = <^2;-+l + «j <#>2,- ' 



'-2J — (J ' %•+! — Vzj+1 

i 
and {<^i} is a complete system of normalized orthogonal functions, {a^} a 
sequence of constants such that { \|a^ } is of finite norm, and p a function such 
that 



fph = ^^ jp'l>.j.^ = ay 



The two matrices {h)^^ and (6),; are unlimited. The function p is orthogonal 
to all the functions v^ ; the system {u^] is complete. The matrices [h\ and 

( « )^ are unlimited for Jpv^. = and therefore v^. = v^. . Functions _/ orthogonal 
to^ can be found for which { J /«,} is not of finite norm and therefore (6)„ is 
unlimited. By considering the biorthogonal system (u., v.): 



u, = 



p = Pfp^i 



1 — fT. — ' "■■•+1 — "-i r 2 ' 

P 



l\ = 



^lfp' 



which is complete both as to u and as to v, we find that (a)^ is unlimited. 
March, 1910. 



